IN THE CLAIMS: 



1. (Original) A method for monitoring responses to test questions presented in a data 
processing system, the method comprising the computer implemented steps of: 

identifying presentation of the test questions on the data processing system; 

responsive to the presentation of the test questions on the data processing system, 
monitoring test question timing data in which the test question timing data represents an 
elapsed time since an answered question from the test questions has been presented; and 

generating an alert after the test question timing data exceeds a threshold. 

2. (Original) The method of claim 1, wherein the monitoring step is performed by a 
proctor device or a program on the data processing system. 

3. (Original) The method of claim 2, wherein the program is an applet. 

4. (Original) The method of claim 1 further comprising: 

billing a client for monitoring the presentation of the test questions. 

5. (Original) The method of claim 1, wherein the test questions are part of a test and 
further comprising: 

storing an identification of a number of test takers for the test; and 
billing a client based on the number of test takers for the test. 

6. (Currently Amended) A method of monitoring a test question response time, 
comprising the steps of: 

administering a test to a remotely located user of a client device; 

receiving test question timing data from the client device, the test question timing 
data representing an elapsed time used by the remotely located user in attempting to 
answer the test question; and 
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outputting the test question timing data to a proctor device such that the proctor 
device may monitor the elapsed time in attempting to answer the test question for the 
remotely located user. 

7. (Original) The method of claim 6, further comprising billing a test developer for 
administration of the test to the remotely located user. 

8. (Original) The method of claim 6, further comprising billing the remotely located 
user for administration of the test. 

9. (Original) The method of claim 6, further comprising sending an instant message 
to the client device. 

10. (Original) The method of claim 6, further comprising receiving an instant 
message from the client device. 

1 1 . (Original) The method of claim 6, further comprising alerting the remotely 
located user when the test question timing data exceeds a predetermined threshold. 

12. (Original) The method of claim 6, further comprising storing a score for the test in 
a permanent storage. 

13. (Original) The method of claim 6, wherein the test is developed by a test 
developer and wherein the method is implemented by a test administration system that is 
operated by a different entity from the test developer. 

14. (Original) The method of claim 6, further comprising: 

receiving a request for administration of the test to the remotely located user; 
establishing a session identification for the administration of the test to the 
remotely located user; and 
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correlating the test question timing data to the administration of the test to the 
remotely located user based on the session identification. 

15. (Original) The method of claim 14, wherein the session identification includes a 
proctor device identifier, and wherein outputting the test question timing data to the 
proctor device is based on the proctor device identifier. 

16. (Original) The method of claim 6, further comprising: 
storing an indicator of a number of test takers for the test; and 

billing a test developer of the test based on the number of test takers for the test. 

1 7. (Original) The method of claim 6, further comprising: 

monitoring the test question timing data for evidence of greater than expected 
response time to the test question, wherein outputting the test question timing data to a 
proctor device is performed in response to determining that evidence of greater than 
expected response time to the test question is present. 

18. (Currently Amended) The method of claim 46 17, wherein monitoring the test 
question timing data for evidence of greater than expected response time to the test 
question includes comparing previously received test question timing data to currently 
received test question timing data to determine if a change in the test question timing data 
indicates evidence of greater than expected response time to the test question. 

19. (Original) The method of claim 6, further comprising generating an alert profile 
for the remotely located user for a particular test based on at least one of a data profile 
associated with the remotely located user, an examination question timing database, and a 
degree of difficulty associated with a question on the test. 

20. (Original) The method of claim 19, further comprising transmitting an alert to the 
remotely located user based on the generated alert profile. 
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21. (Original) The method of claim 19, further comprising storing a response from the 
remotely located user to update the alert profile for use in future tests. 

22. (Original) The method of claim 6, further comprising storing of the timing data 
for the test question to update timing data for the remotely located user for use in future 
tests. 

23. (Original) An apparatus for monitoring responses to test questions presented in a 
data processing system, the apparatus comprising: 

identifying means for identifying presentation of the test questions on the data 
processing system; 

monitoring means, responsive to the presentation of the test questions on the data 
processing system, for monitoring test question timing data in which the test question 
timing data represents an elapsed time since an answered question from the test 
questions has been presented; and 

generating means for generating an alert after the test question timing data 
exceeds a threshold. 

24. (Original) The apparatus of claim 23, wherein the apparatus is a proctor device or 
a program on the data processing system. 

25. (Original) The apparatus of claim 24, wherein the program is an applet. 

26. (Original) The apparatus of claim 23 further comprising: 

billing means for billing a client for monitoring the presentation of the test 
questions. 

27. (Original) The apparatus of claim 23, wherein the test questions are part of a test 
and further comprising: 
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storing means for storing an identification of a number of test takers for the test; 

and 

billing means for billing a client based on the number of test takers for the test. 

28. (Original) A data processing system comprising: 
a bus system; 

a communications unit connected to the bus system; 

a memory connected to the bus system, wherein the memory includes a set of 
instructions; and 

a processing unit connected to the bus system, wherein the processing unit 
executes the set of instructions to identify presentation of the test questions on the a data 
processing system, monitor test question timing data in response to the presentation of the 
test questions on the data processing system in which the test question timing data 
represents an elapsed time since an answered question from the test questions has been 
presented, and generate an alert after the test question timing data exceeds a threshold. 

29. (Currently Amended) An apparatus for monitoring a test question response time, 
comprising: 

a controller; and 

at least one interface coupled to the controller, wherein the controller administers 
a test to a remotely located user of a client device via the at least one interface, receives 
test question timing data from the client device via the at least one interface, the test 
question timing data representing an elapsed time used by the remotely located user in 
attempting to answer the test question, and outputs the test question timing data to a 
proctor device via the at least one interface, such that the proctor device may monitor the 
elapsed time in attempting to answer the test question for the remotely located user. 

30. (Original) The apparatus of claim 29, wherein the controller bills a test developer 
for administration of the test to the remotely located user. 
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31 . (Original) The apparatus of claim 29, wherein the controller bills the remotely 
located user for administration of the test. 

32. (Original) The apparatus of claim 29, wherein the controller sends an instant 
message to the client device via the at least one interface. 

33. (Original) The apparatus of claim 29, wherein the controller receives an instant 
message from the client device via the at least one interface. 

34. (Original) The apparatus of claim 29, wherein the controller alerts the remotely 
located user when the test question timing data exceeds a predetermined threshold. 

35. (Original) The apparatus of claim 29, further comprising a storage device, 
wherein the controller stores a score for the test in the storage device. 

36. (Original) The apparatus of claim 29, wherein the test is developed by a test 
developer and wherein the apparatus is operated by a different entity from the test 
developer. 

37. (Original) The apparatus of claim 29, wherein the controller receives a request for 
administration of the test to the remotely located user, establishes a session identification 
for the administration of the test to the remotely located user, and correlates the test 
question timing data to the administration of the test to the remotely located user based 
on the session identification. 

38. (Original) The apparatus of claim 37, wherein the session identification includes a 
proctor device identifier, and wherein the controller outputs the test question timing data 
to the proctor device based on the proctor device identifier. 

39. (Original) The apparatus of claim 29, further comprising a storage device, 
wherein the controller stores an indicator of a number of test takers for the test in the 
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storage device and bills a test developer of the test based on the number of test takers for 
the test. 

40. (Original) The apparatus of claim 29, wherein the controller monitors the test 
environment data for evidence of greater than expected response time to the test question, 
and wherein the controller outputs the test question timing data to a proctor device in 
response to determining that evidence of greater than expected response time to the test 
question is present. 

41. (Original) The apparatus of claim 40, wherein the controller monitors the test 
question timing data for evidence of greater than expected response time to the test 
question by comparing previously received test question timing data to currently received 
test environment data to determine if a change in the test question timing data indicates 
evidence of greater than expected response time to the test question. 

42. (Original) The apparatus of claim 29, further comprising generating an alert 
profile for the remotely located user for a particular test based on at least one of a data 
profile associated with the remotely located user, an examination question timing 
database, and a degree of difficulty associated with a question on the test. 

43. (Currently Amended) The methed apparatus of claim 42, further comprising 
transmitting an alert to the remotely located user based on the generated alert profile. 

44. (Currently Amended) The methe dapparatus of claim 42, further comprising 
storing a response from the remotely located user to update the alert profile for future 
tests. 

45. (Currently Amended) The mefeed apparatus of claim 29, further comprising 
storing of the timing data for the test question to update timing data for the remotely 
located user for future tests. 
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46. (Currently Amended) A computer program product in a computer readable 
medium for monitoring a test question response time, comprising: 

first instructions for administering a test to a remotely located user of a client 

device; 

second instructions for receiving test question timing data from the client device, 
the test question timing data representing an elapsed time used by the remotely located 
user in attempting to answer the test question; and 

third instructions for outputting the test question timing data to a proctor device 
such that the proctor device may monitor the elapsed time in attempting to answer the test 
question for the remotely located user. 

47. (Original) A computer program product in a computer readable medium for use in 
monitoring responses to test questions presented in a data processing system, the 
computer program product comprising: 

first instructions for identifying presentation of the test questions on the data 
processing system; 

second instructions, responsive to the presentation of the test questions on the data 
processing system, for monitoring test question timing data in which the test question 
timing data represents an elapsed time since an answered question from the test 
questions has been presented; and 

third instructions for generating an alert after the test question timing data exceeds 
a threshold. 

48. (Original) The computer program product of claim 47, wherein the second 
instructions are located in a proctor device or a program on the data processing system. 

49. (Original) The computer program product of claim 47 further comprising: 
fourth instructions for billing a client for monitoring the presentation of the test 

questions. 
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50. (Original) The computer program product of claim 47, wherein the test questions 
are part of a test and further comprising: 

fourth instructions for storing an identification of a number of test takers for the 
test; and 

fifth instructions for billing a client based on the number of test takers for the test. 



Page 10 of 25 
Banerjee et al. - 09/941,251 



